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Abstract 

A rigorous connection is established between the local porosity entropy in- 
troduced by Boger et al. (Physica A 187, 55 (1992)) and the configurational 
entropy of Andraud et al. (Physica A 207, 208 (1994)). These entropies were 
introduced as morphological descriptors derived from local volume fluctua- 
tions in arbitrary correlated microstructures occuring in porous media, com- 
posites or other heterogeneous systems. It is found that the entropy lengths 
at which the entropies assume an extremum become identical for high enough 
resolution of the underlying configurations. Several examples of porous and 
heterogeneous media are given which demonstrate the usefulness and impor- 
tance of this morphological local entropy concept. 



*present address: ICA-1, Universitat Stuttgart, Pfaffenwaldring 27, 70569 Stuttgart 



I. INTRODUCTION 



An accurate geometric characterization of the correlated random microstructures found 
in disordered heterogeneous materials is generally difficult. One possible method consists 
in using globally well-defined morphological descriptors (e.g. volume fraction or specific in- 
ternal surface area) as local descriptors. While local volume fraction fluctuations have been 
discussed previously in the context of porous media and photographic granularity P JH| . |T5| 



the idea of local morphological descriptors has only recently been applied systematically 
in the form of local porosity theory @,^j,p|fl|lTi|6|,[l3|,[7|,[l2i . Local porosity theory general- 
izes the successful and widely used effective medium approximation to correlated random 
microstructures. 

Microstructural information of a different kind can be obtained by applying the Gibbs- 
Shannon entropy concept from information theory to distributions of locally fluctuating 
morphological descriptors. Such "local geometry entropies" were introduced independently 
in || and [0]. It is the primary purpose of the present paper to clarify the similarities and 
differences between the two different local geometry concepts. Furthermore we resolve the 
normalization problem of 0, and provide examples of the usefulness and microstructural 
sensitivity of the local geometry concept. We begin with a discussion of the "local porosity 
entropy" introduced in || in the next section. Subsequently we present the definition of the 
"configurational entropy" as introduced in f2|. In section [TV] we establish the relationship 
between the two concepts, and in section [V] we show that, for sufficiently high resolution, 
they give rise to the same "entropy length". Finally we apply our entropic analysis to 
several examples including percolation models, Poisson grain models, thin films and porous 
sandstones. 
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II. LOCAL POROSITY ENTROPY 



Distributions of local morphological descriptors of random microstructures were intro- 



duced in The local geometry approach was recently reviewed and extended in [12]. In 
the present study we consider for simplicity only two component media in two dimensions. 
Such media are of practical importance as granular metal films for composite coatings. They 
arise also as surface morphologies when sectioning a three-dimensional medium. 

Given a two-component random microstructure in the plane IR 2 let the subset P C 
M 2 denote the set occupied by one of the two components (phases), and M = M 2 \ P its 
complement occupied by the second component. For microstructures obtained by sectioning 
a porous medium the set P represents the fluid-filled pores while the set M is the solid 
mineral matrix. The local volume fraction occupied by the set P within an observation 



region IK is then defined as [p,10,12 



toes n K) fou 

where V(G) denotes the volume (=area) of a set G C M 2 . The local porosity distribution is 
defined as the probability density P JT(]|JT2| 

n{<t>;K) = (6(<f>-<t>(K))) (2.2) 

where 5(x) is the Dirac 5-distribution, and (...) denotes an average over the underlying 
probability distribution governing the configurations of the random microstructure. Note 
that the local porosity distribution depends on the size and shape of the observation region 



IK. Recently |L2] it was found that this dependence disappears in a suitable macroscopic 
scaling limit. In the following it will be assumed that for each IK the function /z(0; K) is 
a given continuous probability density with support on the unit interval. This assumption 
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can be justified by arguing that possible discrete components are always smeared because 
of finite image resolution. 

Local porosity entropies 7(K) are obtained by calculating the Gibbs-Shannon entropy of 
the family of local porosity distributions n(4>; IK) as in 0] 

I(K) = f 1 K) log//(0; K) d(f> (2.3) 
Jo 

which assumes, as usual, a uniform distribution as the a priori weight. Examples of local 
porosity entropies were given in || for synthetic images, and in [|7| for experimental systems. 



III. "CONFIGURATION" ENTROPY 

In |||| the two-dimensional image is discretized into black and white picture elements 
(pixels) forming a quadratic lattice with lattice constant a. The black and white image is 
then analyzed using a quadratic observation region IK (sliding cell) of sidelength L which 
contains M = (L/a) 2 pixels. The observation region is moved to N different positions, and 
the number Nk(M) is defined as the number of cells of size M containing k active (=black) 
pixels. Using the relative frequencies 

MM) - ^ (3.1) 
as estimators for probabilities the "configuration" entropy has been defined as [0 

H " iM) = lJ?TT) = "maTTT) |> (m) logw(M) ' (3 ' 2) 

where H(M) represents the usual Gibbs-Shannon entropy of the discrete probabilities pk(M), 
and M = (L/a) 2 . 
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The expression (|3.2|) does not use the Gibbs-Shannon expression H(M) but divides it 
with log(M+l) similar to multiplicative renormalization in the theory of critical phenomena. 
The normalization was introduced because the underlying probability space changes when 
the number M of pixels inside the measurement cell is changed. The choice l/log(M + 1) 
for the normalization factor however renders H*(M) nonadditive. The next section will 
show that this can be avoided by using the definition (|2.3| ), and that a precise relation exists 
between J(K) and H*(M). 



IV. RELATION BETWEEN THE TWO ENTROPIES 

The relationship between I(K) and H*(M) is established by applying the definitions of 
section |II] to the same discretized quadratic observation region K of sidelength L which was 
used in section |TJ. For such a choice of K the unit interval [0, 1] of porosities is conveniently 
subdivided into subintervals bounded by the porosities 



(4.1) 



M+l 



where < k < M + 1 and M = (L/a) 2 . If /i(0;1K) is given as a continuous function the 
integral in equation fl2.3|) can be approximated as /(IK) = liniM^oo I(M) where 



Al 



I(M) = 5>(0fc;K)log/i(0 fc ;K)(0 fc+1 -0 fc 

o 

1 



k=0 

M 



u + I $>(fo;K)log/z(&;K). (4.2) 
Identifying the probabilities 

^S= P ,(M) (4.3) 
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with the relative frequencies Pk(M) of section |TTT| gives 



M 



J(M) = $>*(M) log[p fe (M)(M + l)] 



(4.4) 



and thus 



I(M) = log(M + 1)(1 - H*{M)) 



(4.5) 



provides a rigorous relationship between the entropies which becomes exact in the limit 
(L/a) — > oo. 

Note, however, that in the continuum limit a — > at fixed L the normalization of H*(M) 
gives rise to a peculiar behaviour of this quantity. While in this limit lim a ^ = I(K) 

becomes a number depending on the local porosity fluctuations as described by //(</>; K), 
equation ( (4.5| ) shows that lim a ^ H*(M) = 1 which is independent of the microstructure. In 
other words the "configuration" entropy H*(M) should not be used to distinguish different 
morphologies in the continuum limit. We suggest calling I(K) "local geometry entropy". 
The generalized name accounts for the fact the /(IK) is readily generalized to morphological 
descriptors other than porosity, such as local specific internal surface areas or local curvatures 



An interesting quantity associated with local geometry distributions is the entropy 
length. The entropy length L* is defined as the length at which I(M) becomes extremal, 



0- 



V. ENTROPY LENGTH 



dI{M)/dL\ L=L * = §. Differentiating Q yields 



J'(M) 



1 



(1 - H*{M)) - log(M + 1)H*'(M) 



(5.1) 



M + l 
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where the prime denotes the derivative with respect to M. For large M, e.g. in the limit 
of high resolution a — > at fixed L, the first term becomes negligible, and thus the entropy 
length can be determined equally from the condition dH*(M)/dL = 0. This is illustrated 
in Figures |T5| and |2| and |3]. Figure [T5] shows the microstructure of a Poisson grain model 
obtained by placing circles of equal radii around centers which are distributed at random 
and with constant number density. The corresponding entropy curves I(M) and H*(M) are 
shown in Figures ^| where, to facilitate the comparison, the curves have been shifted along 
the ordinate to have the same maximum value 0. We have assumed a = 1 which allows one 
to plot the curves as function of the size L of the observation square. Note that the curves 
show two extrema, of which the ones at large M coincide, while the extrema at small M are 
different. The entropy length is an accurate measure of the typical linear size of the different 
phases, pores or components. 



VI. APPLICATIONS 



To illustrate the usefulness of the local geometry concept as a morphological descriptor we 
apply it to several random microstructures. We use two computer generated images of simple 
models for disordered systems, and two experimentally obtained disordered microstructures. 
The two synthetic images are generated from the percolation model on a lattice and from 
the Poisson grain model consisting of uniformly distributed overlapping spheres. The two 
experimental morphologies are observed when a thin film of gold is deposited on a glass 
substrate, and when slicing through a natural sandstone. 



A. Simulated Bernoulli site percolation model 



Perhaps the simplest model of a random microstructure is the site percolation model 
|16| . In this model, each lattice site has a probability (0) of being occupied and (1 — (4>)) 
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of being empty. The occupation of sites is assumed to be statistically independent. A 
configuration of such a system in which the occupied (black) sites represent pore space, and 
the unoccupied ones matrix space is shown in Figure [la] for {(f)) = 0.3. 

The local porosity distribution K) for the percolation model depends only on (0) 
and | K | = M = (L/a) d , and is given by the binomial distribution |T7|JI[. If a hypercubic 
lattice with lattice constant a is considered, then the LPD for a <i-dimensional hypercubic 
measurement cell K of side L reads 



MM) = 4£fS = (6.1; 



U ' U\ (M+l)4> k M _ /^\\ (M+l)(l-0 fc -l/(M+l)) 



[(M + 1) <p k }\ {{M + 1) (1 - 4> h - 1/(M + 1))]! 
where M = (L/a) d , <pk = kj (M + 1) and k — 0,1, ... , M. Its local geometry entropy 



I(M) = log(M + 1) - H(M) = log(M + 1) + E Pk(M) log(p fc (M)) (6.2) 

k=0 

is displayed in Figures ^ and ^| as the curve with triangular symbols. The extrema of the curve 
are at the boundaries. This reflects correctly the fact that the microstructure is homogenous 
and statistically independent at the microscopic resolution (i.e. the lattice constant). The 
value 1(1) = log(2) + (0) log(0) + (1 - (<p)) log(l - (<p)) w 0.08228 is approached for M — 1. 
For M — > 00 the entropy I(L) diverges to infinity (Note that Figure |3| shows —I(L) which 
diverges to —00), while H*(M) in Figure |] approaches a constant. 

To demonstrate the influence of finite system size and statistics we have plotted in 
Figures |3| and ^ also the curves H*(L) and —I(L) determined directly from the image. 
These curves are shown using circular symbols. The agreement with the exact result is 
satisfactory although some deviations are apparent. 
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B. Simulated Poisson grain model 



Another often used model for random microstructures is the Poisson grain model. In 
this model a constant number density of circles (spheres) is randomly placed with uniform 
density into continuous space. Figure [TBI shows a random throw of disks with diameter of 



15 pixels in two dimensions. The porosity of the image is (</>) = 0.5. 

The entropy functions —I(L) and H*(L) for this image differ significantly from those 
for the percolation image. Now the curves show a pronounced extremum while those for 
the percolation case were monotonic. Both curves exhibit an extremum at L* pa 16 corre- 
sponding roughly to the circle diameter of 15 pixels. From other simulations we find that 
the extremum changes with the circle (or sphere) diameter. Hence the position of the ex- 
tremum in —I {Li) or H*{L) is related to a characteristic length scale for the morphology. 
This interpretation is also consistent for the percolation model where the extremum occurs 
at L* pa 1 which corresponds to the pixel diameter. 



C. Experimental gold film morphology 



The image of Figure ITcl represents a digitized and thresholded image of a transmission 



electron micrograph of a thin film of gold on a glass substrate. The film was deposited by 
thermal evaporation under ultra-high vacuum. The evaporation was stopped before the gold 
phase, shown in black, begins to percolate. The surface coverage is (0) = 0.413. 

The curves for the local porosity entropy and the configuration entropy of the gold 
film morphology from Figure [k] are shown using square symbols in Figure and |j. Both 
curves exhibit again an extremum, this time at L* ~ 11. This corresponds roughly to the 
characteristic thickness of black and white regions in the image. The length L* is expected 
to decrease down to the size of the elementary metallic grain at percolation pj. This is the 
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main reason why in it was suggested that the optical properties of these materials have 
to be calculated at scale L*. 



D. Experimental oolithic sandstone morphology 



In Figure [Td| we show a slice through a natural oolithic sandstone. The image was 
obtained by slicing a sample of Savonnier sandstone whose pore space was made visible by 
first filling it with a coloured epoxy resin. The cut surface was polished and photographed. 
The photgraph could then be digitized and thresholded to give a black and white image. 
The threshold was adjusted to match the measured bulk porosity of {(f)) = 0.186. In the 
image shown in Figure [lc| the pore space is coloured black while the rock matrix is shown 
in white. 



The entropy functions for the image of Figure [Lc3] are displayed as curves with cross 



symbols in Figures [3] and |j. Note that there is again a maximum in —I (Li) at L* « 47, but 
this maximum is much broader and less pronounced than for the other images. The curve 
for H*(L) in Figure f| also shows a maximum at L* « 55. It is so flat that it is difficult to 
distinguish from the figure. 

The difference between the values of L* obtained from maximizing H*(L) as opposed 



to —I (Li) can be understood from Eq. (|5.1|) . The equality of the two entropy lengths is 



obtained in the limit M — > oo in which the first term in Eq. (|5.1| ) becomes negligible. For 
finite M the lengths can in general be different. Hence we conclude that for the morphology 
of Figure 0, which represents the most heterogeneous case, the resolution of the image 
needs to be improved before L(M) and H*(M) will give the same entropy length. 
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VII. DISCUSSION AND CONCLUSION 



In this paper we have established an exact relationship between the local porosity entropy 
|| and the configurational entropy of . These two morphological entropies were introduced 
independently by the authors to characterize random but correlated microstructures. We 
have discussed the advantages and disadvantages of the two entropies and suggest to call 
their common element local geometry entropy. It is argued that local geometry entropies 
are a useful morphological indicator for random correlated morphologies. 

The evaluation of the local geometry entropy for selected morphologies indicates the 
existence of a minimum. The position L* of the minimum in the entropy function is called 
the entropy length. The length L* correlates well with a characteristic length scale of the 
microstructure. It is, however, different from the pixel-pixel correlation length. Our analysis 
and past experience indicates that the entropy length L*, as measured here, corrresponds to 
that size of measurement cells at which a finite fraction of measurement cells begin to have 
vanishing local porosity. 

Another observation concerns the width (or curvature) of the extremum. More hetero- 
geneous microstructures such as the one in Figure |Idj appear to show a wider extremum 
than those microstructures, such as Figures lie] or [TBI, in which the black and white regions 



are more compact. This observation is consistent with the findings in || for synthetic mor- 
phologies. Hence we conclude tentatively that the width of the extremum correlates with the 
complexity or heterogeneity of the microstructure. More analyses of synthetic and experi- 
mental data are desirable to further elucidate the geometrical and morphological information 
content of the local geometry concept. 
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FIGURE CAPTIONS 



fa) FIGURE ITil 



Random microstructure of the (uncorrelated) site percolation model in which 
occupied (black) points represent pore space. The porosity (volume fraction of 
pore space) in the image is ((f)) = 0.3. 



(b) FIGURE [Lb 



Poisson grain model configuration with constant point density of circles. Total 
volume fraction of ((f)) = 0.5 



fc) FIGURE lc 



Discontinuous thin film morphology of gold at volume fraction ((f)) = .413 
(d) FIGURE [H 



Planar thin section through a Savonnier oolithic sandstone with pore space ren- 
dered black. The side length of the image corresponds to roughly 1 cm, the total 
porosity is ((f)) = .186 

2. FIGURE | 

Comparison of local porosity entropy —I{L) and configuration entropy H*(L) for the 
Poisson grain model shown in Figure [lb] with disks diameter 15 pixels. Note that the 
curves show extrema at the same length L « 26. The curves are shifted to have the 
same ordinate —I(L) = H*(L) = at the extremum. 

3. FIGURE | 

Local porosity entropy —I(L) || as a function of the side length of the measurement 
cell calculated for all random microstructures shown in Figures [Tal, IT5], llc| and [Lc|. The 



circles correspond to the site percolation image shown in Figure [Ta|. The triangles 
are the theoretical values for an infinitely large image at the same bulk porosity. The 
diamonds are the result for the Poisson grain model shown in Figure |TFJ. The squares 
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represent the experimentally observed gold film morphology of Figure [Tc], while the 
crosses correspond to the sandstone cross section shown in Figure lid. 



4. FIGURE | 

Configuration entropy H*(L) as a function of the side length of the measurement 
cell calculated for all random microstructures shown in Figures [Ta|, [T5|, [Tc] and |IcI|. The 
symbol usage is the same as in Figure |3| and is explained in the figure caption there. 
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